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Abstract 

In [20], the authors addressed the question of the averaging of a slow-fast Piecewise De- 
terministic Markov Process (PDMP) in infinite dimension. In the present paper, we carry on 
and complete this work by the mathematical analysis of the fluctuation of the slow-fast system 
around the averaged limit. A central limit theorem is derived and the associated Langevin ap- 
proximation is considered. The motivation of this work is a stochastic Hodgkin-Huxley model 
which describes the propagation of an action potential along the nerve fiber. We study this 
PDMP in detail and provide more general results for a class of Hilbert space valued PDMP. 

1 Introduction 

In [20], the authors addressed the question of the averaging for the multiscale stochastic Hodgkin- 
Huxley model. This model describes the evolution of an action potential or nerve impulse along 
the nerve axon of a neuron with a finite number of channels which display stochastic gating mech- 
anisms. Mathematically, this stochastic Hodgkin-Huxley model belongs to the class of Piecewise 
Deterministic Markov Processes (PDMP) with multiple time scales. In [5D] we derived averaging 
results for this class of models. The averaged model is still a PDMP of lower dimension. In the 
present paper, we study the fluctuation of the original slow-fast system around its averaged limit. 
A central limit theorem is derived and the associated Langevin approximation is considered. A 
numerical example is also provided at the end of the paper. 

The mathematical analysis of PDMP, and more generally of hybrid systems, constitutes a very 
active area of current research since a few years. An hybrid system can be defined as a dynami- 
cal system describing the interactions between a continuous macroscopic dynamic and a discrete 
microscopic one. For PDMPs, between the jumps, the motion of the macroscopic component is 
given by a deterministic flow. It is essentially this fact that gives the PDMPs their most important 
peculiarity as hybrid systems: they enjoy the Markov property. 
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The PDMPs, also called markovian hybrid systems, have been introduced by Davis in Q31 [TS] for 
the finite dimensional setting and generalized in [7] to cover the infinite dimensional case. Recently, 
the asymptotic behavior of PDMPs have been investigated in [H [5j [El |37j , limit theorems for in- 
finite dimensional PDMPs in [35] , control problems in [TU1 HH H2] , numerical methods in [33J IS] j 
time reversal in [27) and to end up this list with no claim of completeness, estimation of the jump 
rates for PDMPs in [2J. 

Hybrid systems are the object of great attention because they offer an accurate description of a large 
class of phenomena arising in various domains such as physics or biology. For example, in mathe- 
matical neuroscience, a domain the authors are more particularly interested in, PDMP models arise 
naturally in the description of the propagation of the nerve impulse, see [H[7]. This mathematical 
description has been proved to be consistent with classical models such as the Hodgkin-Huxley 
model and compartment type models, see [35] . 

In this paper, the authors are interested in the question of averaging for a spatially extended PDMP 
model of propagation of the nerve impulse and corresponding fluctuations. Averaging is of first im- 
portance because it allows to simplify the dynamic of a system which contains intrinsically two 
different time-scales. Moreover, the averaged limit preserves the qualitative behavior of the original 
dynamical system, see [311132]. In the finite dimensional case these questions have been addressed 
in [3D] and [H]. 

Let us mention at this point that the study of slow-fast systems of Stochastic Partial Differential 
Equations (SPDEs), a framework different from ours but very instructive, is an area of very active 
research. Averaging results have been derived in [3J [35] and fluctuation around the limit and large 
deviations have been studied in [T5] , 

The paper is organized as follows. Section |f ,I| gathers the main notations in use throughout the 



text. In Section 1.2 and 1.3 we recall as briefly as possible the model and the main results of [20] 
and in particular the different properties of the averaged process. Section [2] introduces the main 
results of the present paper: the central limit theorem and the attached Langevin approximation 
are stated. The description of the general class of PDMP which can be included in our framework 
is described. (Section 2.2 1. In Section [3j we begin by proving the Central Limit Theorem in the 



so-called all fast case before considering the multi-scale case, this is Section 3.1 and 3.5 We divide 
the proof in the all fast case in two parts: the tightness in Section [3~2] and the identification of the 
limit in Section [373] Properties of the diffusion operator related to the fluctuations are investigated 
in Section |3.4[ In Section |3.6[ the Langevin approximation associated to the averaged model and 
its fluctuations is considered. A numerical example is presented in Section [4] 

1.1 Notations 

Let / = [0, 1]. L 2 (I) is the space of measurable and squared integrable functions. It is a Hilbert 
space endowed with the usual scalar product 



(/,5)l 2 (/) = J f(x)g(x)dx 

and norm || • = (•, -)l 2 (i)- H = Hq(I) denotes the completion of the set of C°° functions with 

compact support on / with respect to the norm || • II h defined by 



l/lk = J jU{x)f + {f'{x))Hx 
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H is also a Hilbcrt space and wc denote its scalar product simply by (•, •). A Hilbert basis of H 
(resp. L 2 (I)) is given by the following functions on I 



efe (') = /-, r, ^ sin ( fc7r -) ( res P- fk(-) = V / 2sin(fc 7 r-)) 

y/1 + (fcTT) 2 

for k > 1. The dual space of if which is H~ x is denoted by iJ*. < ■, ■ > is the duality pairing 
between H and H* . The triple of Banach spaces H C L 2 (I) C if* is an evolution triple or Gelfand 
triple. The embeddings in between these three spaces are continuous and dense. For any ft E L 2 (I) 
and any u E if: < ft, w >= (ft, u)pm and for any x E I, k > 1 

< S x ,e k >= (1 + (kir) 2 )e k (x) 

The embedding if C C(I, R) also holds and we denote by Cp the constant such that, for all u E if 

sup |u| < Cp||u||h 

We refer the reader to Chapter 1, Section 1.3 for more details. 

In if, the Laplacian with zero Dirichlet boundary conditions has the following spectral decomposi- 
tion 

Au = - ^2(kTr) 2 (u,e k )e k 

k>l 

for u in the domain T>(A) = {u E H]^2 k>l k A {u,e k ) 2 < oo}. It generates the semi-group of 
operators {e At 7 t > 0} dchned for u G if by 



e At u 



J2e~ (k * )2t (u,e k )e k 



k>l 



We say that a function / : if n- R has a Frechet derivative in u G if if there exists a bounded 
linear operator T u : H i— > R such that 

Um /( M + fe)-/( M )-r u (/i) = Q 

ft->0 ||ft|| ff 

We then write ^(m) for the operator T u . For example, the square of the || • ||#-norm and the Dirac 
distribution in x G f are Frechet differentiable on if. For all u G if 

d\\ ■ II 2 rlfi 
^-M(u)[h] = 2(u, ft), ^(«)[fe] = Ma:) 

for all ft G if . In the same way, we can define the Frechet derivative of order 2. The second Frechet 
derivative of a twice Frechet differentiable function / : if —> R is denoted by ^i(it). It can be 
considered as a bilinear form on if x H . For instance 

^LJi( u )[/ l ,/ c ] = 2(/ l ,fc), ^(«)[M] = o, 

for all (ft, k) E H x H. Frechet differentiation is stable by summation and multiplication. 
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1.2 The model 



In this section, we introduce the multiscale stochastic Hodgkin-Huxley model. This model was first 
considered in [T] , and later in [7J [201 13S] ■ Although we are interested in the multi scale stochastic 
Hodgkin-Huxley model, we start by describing the model that does not display different time 
scales, for the sake of clarity. The spatially extended stochastic Hodgkin-Huxley model describes 
the propagation of an action potential along an axon at the scale of the ion channels. The axon, 
or nerve fiber, is the component of a neuron which allows the propagation of an incoming signal 
from the soma to another neuron on long distances. The length of the axon is large relative to 
its radius, thus, for mathematical convenience, we consider the axon as a segment /. We choose 
here / = [0, 1]. All along the axon are the ion channels which amplify and allow the propagation 
of the incoming impulse. We assume that there are N > 1 ion channels along the axon at the 
locati! ons Z{ € / for i e N c]0, 1[ with \Af\ — N. Af is thus a finite set. In [TJ [20] for instance, 
Af = Nn NI, which means that the ion channels are regularly spaced. Each ion channel can be in a 
state £ € E where E is a finite state space, for instance, in the Hodgkin-Huxley model, a state can 
be: "receptive to sodium ions and open". When a ion channel is open, it allows some ionic species 
to enter or leave the cell, generating in this way a current. For a greater insight into the underlying 
biological phenomena governing the model, the authors refer to |24j . 

The ion channels switch between states according to a continuous time Markov chain whose jump 
intensities depend on the local potential of the axon membrane. For two states € E we define 
by the jump intensity or transition rate function from the state £ to the state Q. It is a real 
valued function of a real variable supposed to be, as its derivative, Lipschitz-continuous. We assume 
moreover that: < ct£ ^ < a + for any £, £ £ E and either is constant equal to zero or is strictly 
positive bounded below by a strictly positive constant a_. That is, the non-zero rate functions 
are bounded below and above by strictly positive constants. For a given channel, the rate function 
describes the rate at which it switches from one state to another. 

A possible configuration of all the N ion channels is denoted by r = (r(i), i € Af), a point in the 
space of all configurations 1Z = E 1 ^ : r(i) is the state of the channel located at zj, for i e Af. 
The channels, or stochastic processes r(i), are supposed to evolve independently over infinitesimal 
time-scales. Denoting by u t (zi) the local potential at point Zi at time t, we have 



For any £ € E we also define the maximal conductance and the steady state potentials, or driven 
potentials, of a channel in state £ which are both constants, the first being non negative. 
The transmembrane potential Ut(x), that is the difference of electrical potential between the outside 
and the inside of the axon, evolves according to the following hybrid reaction-diffusion PDE 



We assume zero Dirichlet boundary conditions for this PDE (clamped axon) . The positive constant 
v is the intensity of the diffusion part of the above PDE, for simplicity in the notations we assume 
that v = 1. We are interested in the process (ut, ?"t)te[o,T] ■ The applied current given by the reaction 
term of the PDE is denoted in the sequel by G r (u) and and satisfies 



P(r t+h (i) = Ckt(») = = a u {u t (z;)) h + o(h) 



(1) 




i£j\f 



(2) 




(3) 
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for (u, r) £ H X TZ. The following result of [T] states that there exists a stochastic process satisfying 
equations ^ and ([!]). Let uo be in H such that min^gs < < max^gs v^, the initial potential 
of the axon. Let go S ^ be the initial configuration of the ion channels. 

Proposition 1 ([T|,[7]). Fix N > 1 and Ze£ (f2, J 7 , (.Ft)o<t<T, P) &e a filtered probability space sat- 
isfying the usual conditions. There exists a pair (ut, rt)o<t<T of cadldg adapted stochastic processes 
such that each sample path of u is in C([0,T], H) and r t is in TZ for all t £ [0,T] and {ut,rt)o<t<T 
satisfies Moreover (u t ,r t )o<t<T is a so called Piecewise Deterministic Markov Process. 



The existence of a stochastic process solution of ^ and ([T]) has been first proved in [T]. In this 
paper, the author uses the Schaeffer fixed point theorem to show that when the jump process r 
jumps at rate 1, there exists a solution to |2| and uses the Girsanov theorem for cadlag processes 
with finite state space to recover the dynamic of r. Another approach has been developed in [7]. In 
this paper, the authors construct explicitly the process (u, r) as a piecewise deterministic Markov 
process generalizing in this way the theory of piecewise deterministic Markov process developed 
by Davis from the finite to the infinite dimension setting, see [141 115) . The authors in [7 prove 
that their process is markovian and moreover characterize its generator. Another approach based 
on the marked point process theory is also possible, see for instance |26j and the extension to our 
framework in |35j . 

We proceed now by recalling the form of the generator of the process (u,r). For (uo,r) £ H x TZ, 
we denote by (ip r (t,uo),t £ [0,T]) the unique solution starting from uq of the PDE 

d t u t = Au t + — ^2 Cr(i)(v r (i) - u t (zi))8 Zi (4) 



N 



with zero Dirichlet boundary conditions. 



Proposition 2. Let f be a locally bounded measurable function on H x TZ such that the map 
t h- > /(Vv(£j uo)i r ) is continuous for all (uo,r) £ H x TZ. Then f is in the domain T>(A) of the 
extended generator of the process (u, r). The extended generator is given for almost all t by 

Af{u u r t ) = j t f{u.,r t ){t)+B{u t )f{u u -){r t ) (5) 



whe 



B(u t )f(u t ,-)(r t ) = ^2[f{ut,r t (r t (i) -> C)) - /(«t, r t )]a rt{i)x (ut(zi)) 



with rt(r t (i) — > C) is the element ofTZ with rt{r t (i) — >■ C)0) equal to rt(j) if j 7^ i and to Q if j = i. 
The notation r t )(t) means that the function s f{u' s , r) is differentiated at s — t, where u' 

is the solution of the PDE with the channel state r t held fixed equal to r. 



Let us mention at this point that in Section 3.6 we will work with a slightly different model where 
the Dirac distributions S Zi are replaced by approximations <p Zi in the sense of distributions, in the 
same way as in so called compartment models (see Section [2] for more details) . In this model the 
reaction term is given by 



Gr,<t>(u) = Y C r(i)( v r(i) ~ {u, fizj L 2 (I))<t>Zi 
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for (r, u) <G 1Z x I? (I) . For i € Af, the function <j> Zi which belongs to L 2 (I) approximates the Dirac 
distribution S Zi . Replacing 5 Zi by <p Zi corresponds to consider that when the channel located at Zi 
is open and allows a current to pass, not only the voltage at the point zi is affected, but also the 
voltage on a small area around Zi (see [7]). The family of functions (f> Z{ is indexed by a parameter 
k related to the membrane area considered: the smaller k, the smaller the area. When u is held 
fixed, the dynamic of the ion channel at location Zi is given by 

Hn+hii) = Ch(i) = = «t,C h + o(h) (6) 

for ^(e£andt,/i> 0. 

All the results stated for the model with the Dirac mass 5 Zi hold also true for the model with the 
approximations <j) Zi . We prefer to work in a first part with the model introduced above (that is 
to say with the Dirac distribution) because it corresponds exactly to the model studied in [TJ [2U] . 
However, when considering the Langevin approximation associated to the central limit theorem, 
the formulation with the mollifier <f> Zi appears to be more tractable. 

1.3 Singular perturbation and previous averaging results 

In this section, we introduce a slow-fast dynamic in the stochastic Hodgkin-Huxlcy model: some 
states of the ion channels communicate faster between each other than others. This is biologically 
relevant as remarked for example in [23]. Mathematically, this leads to the introduction of an 
additional small parameter s > in our previously described model: the states which communicate 
at a faster rate communicate at the previous rate divided by s. For an introduction on slow-fast 
system, we refer to [31] . for a general theory of slow-fast continuous time Markov chain, see [39] 
and for the case of slow- fast systems with diffusion, see [3]. 

We make a partition of the state space E according to the different orders in e of the rate functions 

E = E x U • • • U Ei 

where I G {1, 2, • • ■ } is the number of classes. Inside a class Ej, the states communicate faster at 
jump rates of order |. States of different classes communicate at the usual rate of order 1. For 
e > fixed, we denote by (u £ , r s ) the modification of the PDMP introduced in the previous section 
with now two time scales. Its generator is, for / £ T>(A e ) 

A s f{ul,rt) = |/(«f,rf)(t) + B E K)/K,-)(rf) (7) 

B £ is the component of the generator related to the continuous time Markov chain r £ . According 
to ^ and our slow-fast description we have the two time scales decomposition of this generator 

B e = -B + B 

e 

where the "fast" generator B is given by 

i 

B(ui)f(uiri) = J2H E t/teV* (»•!(*) -> 0) - /KV?)K WlC (t4(*)) 

ieN j=i QeE 5 
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and the "slow" generator B is given by 

I 

B{u-)f{utrl) = E E ^-(rlii)) E [/(«t>»?(»f« 0) - /K,rf)K f(i) , c (<4(zi)) 
For y G R fixed and g : M x £" — > M, we denote by Bj(y), i G {1, • • • ,1} the following generator 

Bi(«M0 = 1^(0 E i9(yX) - g(y,0hu(y) 

For any y G M. fixed, and any j G {1, ■ • • , Z}, we assume that the fast generator Bj(y) is weakly 
irreducible on S,*, i.e has a unique quasi-stationary distribution denoted by Hj(y)- This quasi- 
stationary distribution is supposed to be Lipschitz-continuous in y, as well as its derivative. 
Following [39], the states in Ej can be considered as equivalent. For any i £ AT we define the new 
stochastic process (rf)t>o by ff (i) = j when rf(i) £ Ej and abbreviate Ej by j . We then obtain an 
aggregate process f e (i) with values in {1, • • • , I}. This process is also often called the coarse-grained 
process. It is not a Markov process for e > but a Markovian structure is recovered at the limit 
when e goes to 0. More precisely, we have the following proposition 

Proposition 3 (|39j). For any y £ K, i £ Af . the process f £ (i) converges weakly when e goes to 
to a Markov process f(i) generated by 

i i 

B(y)g(r(i)) = '£lj(r(i)) £ (g(k) - g(j)) £ £ a u (y)niv)(Q 
i=i fc=i,Mj ?e-Ej ce-Efc 

with g •.{!,■■■ ,1} — yM. measurable and bounded. 

In order to determine the complete limit when e goes to zero, we need to average the reaction term 
G r (u) against the quasi-invariant distributions. That is we consider that each cluster of states Ej 
has reached its stationary behavior. For any f G 7£ = {1, • • • , l}^ we define the averaged function 

by 

i ' 

F ^ = n E WO) E <*M»-(«(*))(0(«t - u(«i))^ (8) 
Therefore, we call the following PDE 

d t u t = Au t + Fr t {u t ) (9) 

the averaged equation of pi). We take zero Dirichlet boundary conditions and initial conditions 
uo and qo where go is the aggregation of the initial channel configuration go- In equation ([9]), the 
jump process (ft)te[o,T] evolves, each coordinate independently over infinitesimal time intervals, 
according to the averaged jump rates between the subsets Ej of E. For k and j in {1, • • • , I}, the 
average jump rate from class Ej to class E% is given by 

ajk(y) = E E a cAy)H(y)(0 (10) 

We recall now the most important results of [20] and we refer the interested reader to this paper 
for proofs. The first important result is the uniform boundedness in e of the process u e . 
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Proposition 4 (|20j). For any T > 0, there is a deterministic constant C > independent of 
E G]0, 1] such that 

sup \\ul\\ H < C 
te[o,T] 

almost surely. 

The second result states that the averaged model is well posed and is still a PDMP. 

Proposition 5 ([20]). For any T > there exists a probability space satisfying the usual conditions 
such that equation ^ defines a PDMP (ut,ft)te[o,T] i n infinite dimension in the sense of [?]/. 
Moreover, there is a constant C such that 

sup |K||h < C 
*e[o,T] 

and u £ C([0, T], H) almost- surely. 
We can now state the averaging result. 

Theorem 1 (|20j). When e goes to the stochastic process u E solution of £?J) converges in distri- 
bution in the space C([0,T], H) to u, solution of Q). 



2 Main results 

2.1 Fluctuations and Langevin Approximation 

We present in this section the main results of the present paper. The averaging result of Theorem [T] 
above can be seen as a law of large numbers. The natural next step is then to study the fluctuations 
of the slow- fast system around its averaged limit, in other words to look for a central limit theorem. 
For this purpose, we introduce the process 

Ul ~ Ut (11) 



for t G [0,T] and e G]0,1]. 

Theorem 2. When e goes to 0, the process z e converges in distribution in C([0,T], H) towards a 
process z uniquely defined as the solution of the following martingale problem: for any measurable, 
bounded and twice Frechet differ entiable function ip : H — » K, the process 

N^t) := Tp(z t ) - [ g 1 {s)vb{z s )ds (12) 
Jo 

with 

dih~\ dF- d 2 ilA 

Q l m{z) = -J- {z )[Az+ ^(u t )[z]}+Tr^(z)C f (ut) (13) 

for t G [0,T] , is a martingale. We denote by 1 the vector (1, • • • , 1)* G M. N . The diffusion operator 
Cf(u) = Bf(u)Bf(u)* : H* H* is characterized by 

< Cf(u)e*,ei > 

= I < G r {u) - Ff(u),ei >< $(r,ti),ej > fi r (i){u){dr(l)) ■ ■ ■ fi^ N )(u)(dr(N)) 
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where e*(e^) — Sij (Kronecker symbol) for i,j > 1. Moreover $ : H x TZ — > H* is the unique 
solution of 

j B{u)^{r,u) = -(G r (u) - F?(u)), V(u,r)eHxK 

1 /s Jl x...B, J ,*( u ' r )^i(«)(dr) x-.. Xfx jN (u)(dr) = 0, V(ji, • • • ,3n) G {1, • • • , 1} N 

(14) 

where B is the "fast" generator. 



The evolution equation associated to the martingale problem ( 12 ) is the following hybrid SPDE 
(see [13] ) 

dzt = (&z t + ^H«t)fe]) * + flf t («t)dWi (15) 

with initial condition and zero Dirichlet boundary conditions. W denotes the standard cylindrical 
Wiener process on the Hilbert space H. Formally, the cylindrical Wiener process W is defined as 
follows: let {{Pk{t))t>o,k > 1) be a family of independent brownian motions, then 



k>l 

See |13| for more information about the construction of W. A complete description of the diffusion 
operator C is provided is Section 3.4 The well defmitness of equation (15) may be an issue 
since the operator Cj(u) is not of trace class in H for (j,u) G {1, • • • , 1} x H. However, for any 
(j, u) G {1, • ■ ■ , 1} x C([0, T],H) and t > 0, the operator 

Qi-.tp^ j e A(t - s) C,(u s )e A ( t - s Vds 
Jo 

is of trace class in L 2 (I). Thus we can apply classical results from the theory of SPDE in Hilbert 
spaces to deduce the existence and uniqueness of a mild solution to equation (15), see the classical 
reference [13] on this topic. See also [ID] for an introduction to switching diffusions. 
A natural step after having obtained a central limit theorem corresponding to an averaged model 
is to look at the associated Langevin approximation. Formally, the Langevin approximation corre- 
sponds to the averaged model plus fluctuations. In our case this results in the study of the process 
u e defined in the all-fast case for e > by 

du £ = [Au e + F f {u E )]dt + y/sB f (u e )dW t (16) 

with initial condition uo and zero Dirichlet boundary conditions. However, it appears that the 
operator 



with (j, u) € {1, • • • , 1} X C([0, T],H) is not of trace class in H (see the example in Section |4| while 
by definition, the reaction term F is well defined from H to H* . This implies technical issues in 
trying to define properly a solution to equation (16). In order to circumvent this difficulty, we 
consider the reaction term F f ^ instead of F f as follows 

1 ' 

Ff.A u ) = X ^2^2 i j( r i i )) c c^((w,0 z Jl 2 (/))(ok - k (/))</>*, 
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where for i G Af the functions 4> Zi are defined on I by 

K \ K J 

with k small enough such that <f> Zi is compactly supported in I. The mollifier M is defined on K by 

M(a;)=e~^l [ _ ljl] (a;) 
The corresponding non-averaged reaction term is given by 

G r ,<p(u) = — ^ C r (i)(w r(i ) - (tt, <t>z,)Li{I))4>z, 

for (r, it) £ R x L 2 (I). For i e A/", the function </> z . is therefore an approximation in the sense of 
distributions of the Dirac distribution S Zi . Notice that each <fi z . is in L 2 (I) . The biological meaning 
of replacing S Zi by (f> Zi is that when the channel located at Zi is open and allows a current to pass, 
it is not just the voltage at Zi that is affected, but also the voltage on a small area around Zi (see 
[7]). The smaller k, the smaller this the area. When u is held fixed, the dynamic of the ion channel 
at location Zj is evolves according to 

F(r t+h (i) = C|r t (t) = = a u ((«, 2 J L 2 (/) ) + o(h) (17) 

for (,( 6 £ and t,h > 0. It is easy to see that all the results stated in the present paper for the 
the model described in Section 1 are still valid for this class of models. In this case the averaged 
model is given by 

d t u = [Ait + Ff t<j ,(u)]dt (18) 

with initial condition uq and zero Dirichlet boundary conditions. The coupled averaged dynamic 
of the ion channels obeys 

P(ft+h(i) = k\f t (i) =j) = a jk ((u t ,(t) z .)) L 2 {I) )h + o(h) 

for i G J\f, j, k G {1, • • • , 1} and t, h > 0. 

We would like to compare the above averaged equation with the following Langevin approximation 

du £ = [Au e + Fr^(u £ )}dt + <JsB f ,<t,{u e )dWt (19) 

where ^ is defined as the squared root of CV.^ = B f ^B* f ^ and CV,</> is as in Theorem |2j), taking 
into account the changes due to the new form of the model. 

Proposition 6. The following estimate holds, where the trace is taken in the L 2 (I)-sense 

Tr [ e A ^C f ,^s)e A{t - s) ds < V f (a\\u s \\ 2 L2(I) + P\\u s \\ L * {I) + ^e^^^ds 
Jo ^Jo 

for any t G [0, T], and any functions u € C([0, T], L 2 (I)) and averaged state f G {1, • • • ,1} with 
a, f3, 7 three constants. 
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In particular, the operators Q\ are of trace class in L 2 (I) and the Langevin approximation of u is 
then well defined. 

Proposition 7. Let e > 0. The hybrid SPDE: 

du £ = [Au e + Fr^(u £ )}dt + y/eBr :4 ,(u e )dW t (20) 

with initial condition uq and zero Dirichlet boundary condition, has a unique solution with sample 
paths in C([0, T], L 2 (I)). Moreover 

sup E(||«?||£ a(J) ) < +oo (21) 
te[o,T] 

We can now compare the Langevin approximation to the averaged model u. 
Theorem 3. Let T > held fixed. The Langevin approximation satisfies 

limE[ sup ||u t -^|| 2 L2(/) j =0. (22) 
\te[o,T] 7 

Therefore, it is indeed an approximation of u. 

2.2 General Framework 

The arguments developed for the averaging in [20] as well as those leading to a central limit theorem 
and a Langevin approximation presented in the present paper are also valid in a more general setting 
that we describe in the present section. As mentioned in the Introduction, we provide detailed proofs 
for the stochastic Hodgkin-Huxley model. Their extension to the general class of PDMP described 
below is straightforward. We first describe a set of assumptions on the infinite dimensional PDMP 
that will ensure these results. Let A be a self-adjoint linear operator on a Hilbert space H such 
that there exists a Hilbert basis {e k , k > 1} of H made up with eigenvectors of A 

Ae k = -l k e k 

for k > 1 and such that: 

sup sup \e k (y)\ < oo 

fc>l y£l 

The eigenvalues {l k , k > 1} are assumed to form an increasing sequence of positive numbers enjoying 
the following property 

Let 1Z be a finite space. For any r 6 K, the reaction term G r : H n- H is globally Lipschitz 
on H uniformly on r G 1Z. That is to say, there exists a constant Lq > such that for any 
(r, u, u) G 1Z x H x H we have 

\\G r (u) - G r (u)\\ H < L G \\u - u\\ H 

For fixed u £ H let Q(u) :— (q r r(u)) (r,f)eizxiz be an intensity matrix on 1Z associated to a continuous 
time Markov chain (r t ,t > 0). We assume that for r ^ r, the intensity rate functions q r ? : H H> 
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R + arc uniformly bounded and Lipschitz. There exists two constants B q ,L q such that for any 
(r, f, u, u) E TZ x TZ x H x H we have 

sup sup q r f (u) < B q , |<7 r f (u) — g r f (u)\ < L q \\u — u\\ h 

(r,f)£RxR u£H 

Moreover the intensity rate functions are supposed to be uniformly bounded below: there exists a 
positive constant g_such that 

inf inf q r f(u) > q_ 

We also assume that there exists a unique pseudo-invariant measure associated to the generator 
Q(u) which is bounded and Lipschitz in u. 

Let T > be a fixed time horizon. We consider the following two time-scale evolution problem 

d t u e t = Au\ + G rt {u e t ) . . 

nr! +h = f\rt = r) = \q rf {i4)h + o{h) [Z6) 

for t £ [0, T], with e > 0. This is the so called all- fast case: there is only one class of fast transitions 
in the state space TZ and this is TZ itself. The multi-classes case can be deduced from the all-fast 
case without difficulty. Let us first state the averaging result. 

Theorem 4. The process (uf,t G [0, T]) converges in law in C([0,T],H) towards u solution of the 
averaged problem 

d t u t = Au t + F(u t ) 
for t G [0, T], where the averaged reaction term is given for u € H by 

F(u) = [ G r {u)iJL{u){dr) 
Jn 

Let z e be the fluctuation around the averaged limit. For t G [0, T], z t is defined as 

_ i4-u t 

Then, the central limit theorem takes the following form. 

Theorem 5. The process {z\,t <E [0,T]) converges in law in C([0,T], H) towards z solution of the 
SPDE 

dF 

dzt = [Azt + —(ut)[zt]]dt + B(u t )dW t 
The diffusion operator C(u) — B{u)B(u)* is characterized by 

C{u)e*j,ei >= / (G r (u)-F(u),ei)($(r,u),ej)/i(«)W 
Jn 

where e*(ei) = 5ij for i,j > 1. Moreover $ is the unique solution of 



< 



B{u)<5>{r,u) = -(G r (u) - F(u)) V(u,r)effxK 
f R $(r,u)n(u)(dr) = 



(24) 
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We can then consider the Langevin approximation (uf,t <E [0, T]) solution of the SPDE 

du e t = \Au\ + F(u\)]dt + y/eB(u e t )dW t 

for t £ [0,T]. The Langevin approximation is well defined in C([0,T], H) and the following propo- 
sition holds. 

Proposition 8. Let T > 0. The Langevin approximation (uf,i € [0, T]) satisifes 

limEl sup || u t - uf \\% ) = (25) 
\te[o,T] J 

Therefore it is indeed an approximation of the averaged process u. 



3 Proofs 

We now proceed to prove Theorem [2] and Theorem [3] In Theorem [2] we want to prove the con- 
vergence in distribution of the process z e when e goes to zero. As usual in this context such a 
proof can be divided in two parts: the proof of tightness of the family {z e , e e]0, 1]} which implies 
that there exists a convergent subsequence and the identification of the limit which allows us to 
characterize the limit and prove its uniqueness. We write in full details the proof in the all fast 
case, that is when all the states in E communicate at fast rates of order |. In this case there is a 
unique class of fast communications which is the whole state space E (in this case I = 1 w.r.t. the 



notation of section 1.3). The multi-scale case (when I > 1) can be deduced from the all fast case 
and is mainly a complication in the notations. The comments on the extension to the multi-scale 
case are postponed to Section |3.5| Section |3.6| is devoted to the proof of Theorem [3j 



3.1 The all fast case 

For the sake of clarity, we first rewrite the statement of Theorem [2] in the all fast case. When all 
states in E communicate at fast rates, for each e > 0, the generator of the process (u £ ,r £ ) is given 

by 

A e m,r!) = ±f(u £ ,rl)(t) + -B(ul)f{ulWt) (26) 
where the slow part of the generator reduces to zero and 

B(ul)f(ulrl) = ]T ]T[/(u?,r t £ (7f (*) -> 0) - /«,OK«(i),e(«?(*i)) 

i£.\f ZEE 

where r t (rt(i) C) is the element of 1Z with r t (r t (i) — » Q(j) equal to r t (j) if j ^ i and to £ if j = i. 
For any i € Af with u G H held fixed, the Markov process r(i) has a unique stationary distribution 
fi(u(Zi)). Then the process (r(i),i G Af) has the following stationary distribution 

= (££M"0i)) 

lEN 



13 



The averaged generalized function reduces to 

F(u) = [ G r (u)fi{u){dr) (27) 
Jn 

The averaged limit u is solution of the PDE 

d t u t = Au t + F(u t ) 

with initial condition ii and zero Dirichlet boundary conditions. In this case Theorem [2] reads as 
follows. 

Theorem 6. When e goes to the process z 6 converges in distribution in C([0, T],H) towards a 
process z. This process is uniquely determined as the solution of the following martingale problem: 
for any measurable, bounded and twice Frechet differentiable function ip : H —¥ M., the process 

N^(t) := ^j(z t ) - f g 1 {s)^{z s )ds (28) 
Jo 

where 

dipl . . r . dF , .... _, cPibl , . . 
= -%-(z)[Az+— (u t )[z +Tr-^ (z)C(u t ) 
dz du dz z 

for t G [0,T], is a martingale. We denote by 1 the vector (1, • • • , 1)* e Mr. The diffusion operator 
C(u) = B(u)B(u)* is characterized by 

< C(u)e*,ei > 

< G r {u) - F(u), e t >< $(r, u),ej > fi(u)(dr) 

n 

where e|(ej) = 5{j for i,j > 1. $ is £/ie unique solution of the equation 

B(u)$(r,u) = -(G r («)-F(u)) 



/ B *(r,«)M(u)(dr) = (29) 

The associated evolution equation is the following stochastic partial differential equation 

dz t = \ Az t + ^ (ut)[zt]j dt + B(u t )dW t (30) 

with initial condition and zero Dirichlet boundary conditions. We remark that in this case, the 
limiting process z is solution of an SPDE which is no longer hybrid. 
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3.2 Tightness 

To show that the family {z £ ,e €]0, 1]} is tight in D([0,T], H), we use Aldous criterion (cf. 28 ) 
which can be splitted in two parts as follows. 

Criterion 1 (General criterion for tightness [28]). Let us assume that the family {z £ ,e G]0, 1]} 
satisfies Aldous's condition: for any 5, M > 0, there exist i],eo > such that for all stopping times 
t with t + rj < T, 

sup sup P(||4 +f) - z s t \\h > M) < S (31) 

ee]Q,e ] ee]0, V [ 

and moreover, for each t £ [0, T], the family {z £ ,s s]0, 1]} is tight in H. Then {z £ ,e s]0, 1]} is 
tight in B([0,T],H). 

Criterion 2 (Tightness in a Hilbert space |28|). Let H be a separable Hilbert space endowed with 
a basis {e/c, k > 1} and for k > 1 define 

Lk = span{ei, 1 < i < k} 

Then (zf,e €]0, 1]) is tight in H if, and only if, for any 6, n > there exist p, e$ > and Lg tV C 
{Lk, k > 1} such that 

sup F(\\z s t \\ H >p) <6 (32) 
E e]o,£ ] 

sup V{d{zlL s ^) >ri)<5 (33) 

£6]0 : e ] 

where d(z £ ,L$^) = inf^g^ \\z £ — v\\h is the distance of z £ to the subspace Ls tV . 

We begin by showing that for a fixed t £ [0, T], the family {z £ ,e g]0, 1]} is uniformly bounded in 

L\n,Hl{i)). 

Proposition 9. There exists a constant C depending only on T but otherwise neither on t £ [0, T] 
nor on e £]0, 1] such that 

E(lk1l 2 H ) < c 



In particular, for any fixed t £ [0,T], condition (32) is satisfied by the family {z £ ,e £]0, 1]}. 
Proof. Let t £ [0,T] and e G]0, 1] be fixed. We have: 

= 2 < d t (ut - u t ),u £ t - u t > 

= 2 < A(u £ t - u t ), u% - u t > +2 < G r e (u £ t ) - F(u t ),u £ t - u t > 

= 2 < A(u £ t - u t ),u £ t -u t > +2 < Gye(uf) - F(u £ t ),u £ t -u t > 

+ 2<F(u £ t )-F(u t ),u £ t ~u t > 

almost surely. We treat each of the above terms separately. From the spectral decomposition of 
the Laplacian operator we deduce that the first term satisfies 

2 < A(ut - u t ),u £ t - ut >< -2iT 2 \\u £ t - u t \\ 2 H . 



15 



Regarding the third term, we notice that the application u F{u), u > is locally Lipschitz on H 
and that the quantities u\ and Ut are uniformly bounded w.r.t. t £ [0, T] and e S]0, 1] thanks to 
Propositions [T] and |4j Thus there exists a constant C, independent of t € [0,T] and e s]0, 1], such 
that 

2 < F(ti£) - F(u t ),u e t - u t >< C\\u £ t -u t \\ 2 H 
Integrating over [0, t] and taking expectation yields the following inequality 

E(K-«tHir) 

< E(\\u £ > -u \\ 2 H )+2(C-ir 2 ) / E(\\u £ s -u s f H )da 

Jo 

+ Efj2<G rt (u e s )-F(u e s ),u e s -u s >ds S 

Let us consider the latter of these terms. Using the same approach as the one developed for the 
identification of the limit in the proof of the averaging result in [30] , we deduce the existence of a 
constant C(T) depending only on T such that 



E / 2<G r e(u e s )-F(u £ s ),u £ s -u s >ds 



o 



< C(T)e 



For the sake of completeness, we review now briefly this approach and refer to |20| for more details. 
The first point is to show, as in Proposition 6 of [20] , that there exists a measurable and bounded 
function / : H xKx [0, T] -> K such that J n f(u, r, t)fi(u){dr) = and for all (u, r, t) e H xKx [0, T] 

B{u)f{u, -,t)(r) =< G r {u) - F(u), u-ut> (34) 

Then using the regularity of the mappings (u,r,t) G H x 1Z x [0, T] h^< G r (u) — F(u),u — u t > 
and the operator B(u) for u £ H, we deduce that the application (it, r, t) £ H x 1Z x [0, T] h^< 
G r (u) — F(u),u — u t > is bounded, Frechet differentiable in u with bounded Frechet derivative 
and differentiable in t with bounded derivative. Using the general theory of Markov processes, we 
deduce that there exists a martingale M £ such that 



f(ut,r £ t ,t) 



f(u £ ,r £ ,0)+ / A e f(u £ ,r e s ,s)ds + M £ 



1 . f* d ...... . d 



= /(«§ s rg,0) + - ^ 6«)/«,r s e , s )rf s + ^ _/(n e ,rf, S )( S ) + -/«,rf,0(s)ds + M t e 



1 /■* 

= /(«§,r§,0) + - / <G rS (tt;)-F(«S),«S-u.>d8 
£ Jo 

Therefore 

rt 

< G rf (u £ ) - F(u £ s ),u £ s - u s > ds 



e/K, rf , t) - r§, 0) - a \ -f(u £ , r £ , a) (a) - -f(u e „ r £ , -){a)da - eM £ t 
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Taking the expectation , using the fact that M e is a martingale and that / is regular, we obtain 
the desired estimate. 

Assembling all the above estimates we obtain 
E(IK " Mh) 

< E(||u§ - u f H ) + C(T)e + 2{C - n 2 ) [ E(\\u e s - u s \\ 2 H )ds 



Since u £ a — Uq a standard application of the GronwalPs lemma yields the desired result. We fend up 
this proof by showing that for any fixed t <E [0, T], the family {zf,e G]0, 1]} fulfills the requirement 
(32). Indeed, let 8 > and denote by C the constant independent of £ and t € [0, T] such that 

E(\\z e t \\ 2 H )<C 

By the Markov inequality we have, for p > 0, 

SUP P < fl > p) < sup V " t 2 UHJ < 
ee]0,l] e£]0,l] P P 

and for p large enough, we obtain that sup £g ] X ] P(||zf \\h > p) < 5. □ 

Notice that by the compact embedding of H in L 2 (I), it follows from Proposition [9] that for any 
fixed t € [0,T] the family {z £ ,e E]0, 1]} is tight in L 2 (I). However, this is not sufficient for our 
purpose and we now prove the tightness of the family {z £ ,e G]0, 1]} in H for any fixed t S [0, T]. 
This is the object of the following propositions. 

Proposition 10. Let t S]0,T] and for p > 1 let us define the following truncation 

p 

k—l 

Then 



km E||4-z^|r ff = 



uniformly in e €]0, 1]. 

Proof. For a fixed k > 1 we have 



f t (zl,e k ) 2 = 2(zl,e k )j t (z £ t ,e k ) 



= 2(zl,e k )(-(k7r) 2 (zf,e k ) + < G rf «) - F{u t ),e k 

= -2(kir) 2 (zf,e k ) 2 + ^-(zl,e k ) < F(u £ t ) - F(u t ),e k > 
2 

+ -^(zf,e k ) <G r e(u E t )-F(u e t ),e k > 
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almost surely. We recall the interpretation < d Zi , e k >= (1 + (kTr) 2 )ek(zi). Then a direct computa- 
tion using the arguments developed in the proof of Proposition [9] yields the existence of a constant 
C(T) independent of e G]0, 1] such that 

{zl e k ) 2 < C(T)(1 + (fcTr) 2 ) - (fcTr) 2 f\zl,e k ) 2 ds 

Jo 

almost surely. Using Gronwall's lemma we deduce that 

(zl,e k ) 2 <C(T)(l + (k7r) 2 )e-^ 2t 

The result follows since the series + (kn) 2 )e~( k ^ 2t is convergent for t > 0. □ 

We now check that the family {z 6 , e G]0, 1]} satisfies the first part of Aldous criterion that we have 
called Criterion [U 

Proposition 11. Let t > be a stopping time and 9 > such that r + 9 < T . There exists a 
constant C depending only on T such that 

nU + e~-4\\ 2 H )<C6 

Proof. We notice that for t > and 9 > such that t + 9 < T 

1 



de(z £ t+e - z e t ) = Az E t+e + -j,(G rl+e {u £ t+e ) - F{u t +e)). 



Thus almost surely 
d „ „ 



~^Q~\\^t+e ~ z t\\H — 2 < Az £ +g , z £ +g — zl > 



2 

+ - < G r e (u$ +e ) - F(u t +e), u £ t+e + ut- u t+e - u\ > 



The first term satisfies 

< Azf +6) , zl +e — z £ > < 



1 



6\\h + oll 2 t+0 — z t \\h 



2" 2' 

which is uniformly bounded in t, 9 and e in expectation by Proposition [9] For the second term, the 
arguments developed in the proof of Proposition [9] yield the existence of a constant C depending 
only of T such that 



Jo 

and thus, still denoting by C a constant depending only of T 

E(\\z £ t+e -z £ t \\ 2 H )<C9 

The same arguments apply when replacing t by the stopping time r. □ 

According to Criteria [l] and [2j Propositions |9j [To| and 11 the family {z £ ,e e]0, 1]} is tight in 
D([0, T], H). The continuity of each of the elements of the family implies that {z £ , e €]0, 1]} is tight 
mC([0,T],H). 
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3.3 Identification of the limit 

For an introduction to the approach used in this section in a similar, but finite dimensional, case, 
we refer to [38] . We want to prove uniqueness of an accumulation piont z of {z £ , e €]0, 1]} and 
identify the limit. For this purpose, we study the process (z £ ,r £ ) for e <E]0, 1]. Notice first that the 
process z e satisfy the following equation 

d t zt = Azl + ^=(G r .(ut) - F(u t )) 

= Az e t + -^(G r| {u t + yfez e t ) - F{u t )) 

where we have used that: u £ t — u t + u £ t — u t — u t + \/sz £ . The initial condition for z £ is and the 
boundary conditions are still zero Dirichlet boundary conditions. 

Let 4> : H x 7Z x R + be a real valued, measurable and bounded function of class C 2 on H and C 1 
on R_|_. We write down the generator of the process (z £ ,r £ ) against </>. For (2, r, t) € H x 1Z x K + 
we have 

Q{t)<t>(z,r,t) (35) 
= ^t( z ,r,t)[Az+±=(G r (u t + ^z)-F(u t ))] (36) 

+ -B(u t + ^zU(z,r,t) + d t <f>(z,r,t) (37) 
e 

Following the usual theory of Markov processes, the process (AI^(t),t £ [0,T]) defined for t > by 

Ml{t) = <f>{zl rl t) - [ G( S )<f>(z £ , r £ s , s)ds 
Jo 

is a martingale for the natural filtration associated to the process (z £ ,r £ ). We want to identify the 
terms of different orders in e of this martingale process. For this purpose, we choose a function <fr 
with the following decomposition 

<t>{z, r, t) = i/)(z, r) + r, t) 

where the functions -0 and 7 have the same regularity as <f>. We write the Taylor expansion in e of 
the two following terms 

dG 

G r (ut + V£z) = G r {ut) + Ve—^{u t )[z] + 0(s) 

au 

B(u t + V^z) = B(u t ) + ^^-(u t )[z}+0(e) 

au 



Inserting this expansion in the expression of the generator ( 35 ) we want the terms of order 1 to 
vanish and this yields for (z, r, t) € H X TZ X R + 

B(u t )^(z,r) = (38) 

That is to say, the application ip does not depend of r € TZ and is of the form 

%l>(z, r) — ip(z)l 
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where ip : H — > K is of class C 2 and 1 is the vector (1, • • • ,1)* G K. . The generator is then of the 
following form, where we gather the terms of the same order in e 

G(t)cj>(z,r,t) 

= ±= (^(z)[G r (u t )-F(u t )]+B(u t )j(z,r,t) + ~ (u t )[z}^(z)l 
\Je \ dz du 

+ d j^(z)[Az + d f 1 (u t )[z\] + ^(z,r,t)[G r (u t ) - F(u t )} + f-(u t )[z] 7 (z,r,t) 
dz du dz du 

+ (da{z,r,t) + ^(z,r,t)[Az + 

We now want the terms of order to vanish, that is to say, for (z, r, t) E H x 7Z x M + 

^(*)[G r (ut) - F(«t)] + B(u t )~f(z, r, t) + f-(u t )[z]^(z)l = 
dz du 

Notice that B(u t )l = implies that for all (z, t) e H x R + 

dB . 



and we are left with the equation 



(u t )[z}^(z)l = 



#1 



We look for 7 of the form: 



B{u t )~f{z,r,t) = ~^—(z)[G r (u t ) - F{u t )} 
dz 



7(z,r,t) = — — (z) $(r,u t ) 



(39) 



where $ : H x 7\L — ► H has to be identified. Inserting the above expression of 7 in (39) we obtain 
^( Z )[B(n t )$(r, Ut )] = -^( z )[G r (u t ) - F(u t )] 

And thus it is enough that for any (u, r) G H x TZ 

B(u)<S>(r, u) = -(G r (u) - F(u)) 



(40) 



To ensure uniqueness of the solution for equation ( 40 ) we impose moreover the condition 



<S>(r,u)(i(u)(dr) = 



■R 



Then, from the definition of F we have f n (G r (u) — F(u)) u(u)(dr) — and the Fredholm alterna- 
tive ensures us of the existence and uniqueness of $ solution of equation ( 40 ) . 
We have identify the terms of order 1 in e of the generator of the process (z e , r e ). We are left to 
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show that the terms of order 1 in e correspond, after averaging, to the generator of the process z. 
For (z, r, t) e H x K x K + wc define 

= ^(z)[Az + ^ («*)[*]] + ^(z)mr,u t ),G r (u t ) F(u t )\ 
Let us define also the following process 



(*)=#*?)- /V(*,rSM*f)dfl 
Jo 



By construction we see that E(|M|(i) — A^(t)| 2 ) = 0(e). When e goes to 0, by the averaging result 
we see that the term J Q * G 1 (s, r e s )\j){z e s )ds should converge to 



f [ G\ss 
Jo Jn 



,r)ip(z s )/j,(u s )(dr)ds 

Therefore, the aim of the end of the proof is then to show that the process defined by 

N+it) = i/>(zt) - f G 1 (s)^(z s )ds 
Jo 

where z is an accumulation point of the family {z £ ,s €]0, 1]} and 

g'miz) 

dilA dF d 2 ilA f 

= -J-( z )[Az+—(u t )[z]} + ^(z) Jj$(r,u t ),G r (u t )-F(u t )Hu t )(dr) 



is a martingale for the natural filtration associated to the process (z t ,t > 0). It is not straightforward 
because we have no information on the asymptotic behavior of the process (z e ,r e ) when e goes to 
0. 

Proof. Let 0<ti<t 2 <---<t k <s<tbck + 2 reals, with k > 1 an integer. For i £ {1, • • • , k}, 
we take a measurable and bounded function gi . In order to show that the process (N^ (t),t > 0) is 
a martingale for the natural filtration associated to the process [z u t> 0) we will prove that 

E((Jfy(i) - N^ S )) gi (z tl ) ■ ■ - Sfc (z t J) = 

We write, using elementary substitution and the fact that z £ converges in law toward z when e goes 
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to 



E((N il (t)-N^(s))g 1 (z tl )---g k (z tk )) 
E((ij(zt)-^(z s )- [ g 1 m(z l )dl)g 1 (z tl )---g k (z t J) 



= E((V(z t ) - iP(z s )) gi (z tl ) ■ ■ ■ g k (z tk )) - E(( J GHlWz^g^) ■ ■ ■ g k {z tk )) 
limE((^f) - • • • g k {zt)) - E(( / G 1 {mzi)dl) gi (z tl ) ■ ■ ■ g k (z tk )) 



e-s-0 



UmE((A^(i) - N^s)) 9l {zl) ■ ■■gkizlj) 



e-s-0 



+ limE((/ g 1 (l,r^(zf)dl)g 1 (zl 1 )---g k (zl))-E(( PQMztWg^) ■ ■ ■ g k (z tk )) 



limE(( J g\l,rf)^)dl) 9l {zl)---g k {zl))-E{{ J G 1 (IMz^g^J ■ ■ ■ g k (z tk )) 
lhnE((^g 1 (; j rf)^(zf)rf/).9i(4) • ■ ■ g k {4 k )) - E((£ G'^rf^z^g^) ■ ■ ■ g k (4 k )) 
limE(( [ Q^rfMzfWfrizZJ ■ ■ ■ g k (zt k )) -E(( f G'^rfWz^g^) ■ ■ ■ g k (z tk )) 



On one hand, by the definition of and the previous study of the different order in e of the 
martingale M| we see that 

limE((JV;(t) - ms)) gi (zl) ■ ■■gkizlj) 

= limE((JV£(f) - • • .g k (zl k )) - E((M|(t) - M|( S )) 5l (4) • • • fffc (z|J) 

= lim OUfe) 

e->0 

= 

On the other hand, for e 1 > which will be chosen later 



+ \unE((J* G 1 (l,rf)'ip(zi)dl)gi{z tl ) ■ ■ ■ g k {z tk )) -E({j G 1 {l)^{zi)dl)gi{z tl ) ■ ■ ■ g k {z tk )) 

We know that the quantity 

E(( f G\l,rf)^{z l )dl)g l {z tl ) ■ ■ ■ g k {z tk )) - E(( / <f(0V> WO^J • • ■ 9k(z tk )) 

J s J s 

can be made arbitrarily small by conditioning appropriately (as in the proof of Proposition [9] for 
example) by choosing e 1 small enough. Then, since z £ converges in law towards z when e goes to 
0, we have 

linw, E((J G 1 (l,rf)TP(zf)dl)g 1 (z5 i )---g k (z$ h ))-E((j ' G'^rf^z^g^) ■ ■ ■ g k (z tk )) 
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limE(( / l (i,rf)V>(2f)dOsi(4) • ■•fffc(4J) / ^(O^MM^) ■ ••flfc(^J) = 



This shows that 

( Z(( / 
and finally 

E((N 4 ,(t) - N^( S )) gi (z H ) ■ ■■g k (z tk )) = 
as announced. □ 

Thus the limit process z is solution of the following martingale problem: for any measurable, 
bounded and twice Frechet differentiable function ijj the process defined for t € [0, T] by 

N^(t) = ip(z t ) - f g\s)^{z s )ds 
Jo 

where: 



g\t)4,{z 

uz aw czz 



( 2 )[Az+— (ut)[«]] + -^-(z) / [$(r, U i),G r (^)-^K)]Mwt)(^) 



re 



is a martingale. 

The limit process z is therefore solution of the martingale problem associated to the operator Q . 
Then z is a solution of the SPDE ^ where the diffusion operator C{u) for ii e if is identified 
thanks to the relation 

^*(z) / mr,u) 1 G r (u)-F(u)Uu)(dr)=Tr d ^(z)C(u) 
dz z J K dz z 

for (u, z) G H x H. The uniqueness of z follows from the properties of the Laplacian operator, 
the reaction term 4^ and the trace class operator C{u). For more insight in the properties of the 
diffusion operator, see the following section. 

3.4 On the diffusion operator C 

In this section, we give more precision on the diffusion operator C. First, we explicit the function 
$ in function of the data of our problem. 

Proposition 12 (First representation of the diffusion operator). For u £ H and r £ R we have: 

*(r,«) = -0(u)>(u) +B*(u)B(u))- 1 B*(u)(G.(u) - F(u))(r) 

That is, the function is explicitly given in function of the intensity operator B(u) and the 

associated invariant measure n(u). 

Proof. The application 3> is defined by the two conditions 

B(u)$(r,«) = -{G r (u) - F(u)) 
/ w #(r,u)A*(u)(dr) = 1 ' 
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for (u, r) € H X 7Z. Let u £ H held fixed. Defining D(u) — (/i(u), B(u)) T , we have that (41 1 reduces 
to 





D(u)$(-,u) = - 
Then 



G.{u) - F(u) 



D*{u)D(u)&(-,u) = -D* 



u 





G.(u)-F(u) 

The key point is that the operator D* (u)D(u) is invertible. Indeed 



D*{u)D(u) = n{u)*n{u) + B*(u)B(u) 

and the kernel of the two operators fi{u)* fi{u) and B* (u)B(u) are in direct sum and span the whole 
space R N . Let x e R^, then x = z + y with z e Ker/i(u)*/i(u) and y G KcrS*(u)£>(M). We have 

^(«)V(«)y + B*(«)B(«)z = 

Since = (where 1 e R' TC ') and fi(u)l = 1, multiplying the above equation to the left by 1 T 

we have 

jti(u)y = 

Since y € KerB* (u)B(u) = KerS(u) = spanl here, we have y = yl with y € R and 

iu(ti)y = = y 

and thus ?/ = and y = 0. Therefore x = z € Ker/i(u)*/z(«) and 2?*(m)£>(u)z = 0. Thus z € 
Ker/x(u)*^(M)nKer£>*(w),B(u) = {0} and x = z = 0. The operator D*(u)D(u) is then invertible. □ 

Proposition 13 (Second representation of the diffusion operator). For any (u,r) € H xTZ 

poo 

$(u,r)=/ E r (G r u(u) -F(u))ds 



where r u has the same law of r when u is held fixed. 

Proof. It is a direct consequence of the fact that the process defined by 



Jo 

is a martingale for the natural filtration associated to the process r u . Then, taking expectation and 
recalling that 

B(u)*(r,u) = -(G r (u) - F(u)) 
J n ^>(r,u)n(u)(dr) = { > 



yields: 



Since: 



E r (*(«,r{')) = $(u,r)- / E r (G r »(u)-F(it))da 



lim E. r ($(u,r 4 n )) = / $(r,ttW«)(dr) = 



in 

the desired result follows. □ 
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Proposition 14. The diffusion operator C(u), for u € H , is positive in the sense that 

Tr C{u) > 
Therefore the operator B(u) is well defined. 
Proof. For u € H we have: 

Tr C{u) = ^2 <G r (u)-F(u t ),e k ><<f>(r,u),e k > /J,(u)(dr) 
k>i Jn 

= ~ / < B(u)$(r, u), e fc >< $(r, w), e fc > n{u)(dr) 
k>x Jn 

> 

because of the negativity of the operator all the eigenvalues of the operator B(u) are non 

positive. □ 



3.5 The multi-scale case 

Let us recall that by multi-scale case we mean the case when there is at least two spaces E t or in 
other words, the ionic channels exhibit different time scales. 

For the tightness and the identification of the limit, this is, as said before, mainly a complication in 
the notations and this is why we will be very brief in this section. We refer for example, in the finite 
dimensional case, to the work of |38j or in our framework for the proof of averaging, to Section 3.2 
of [5D]. For another instructive example dealing with slow-fast continuous Markov chain, see [55] , 



3.6 Langevin approximation 

This section is devoted to the study of the Stochastic Hodgkin-Huxley model with mollifier. The 
model is presented in Section [2] More particularly, we are interested in this section by the Langevin 
approximation of the averaged model. We begin by the proof of Proposition [6] and [7J As for the 
Central Limit Theorem we detail the proof only in the all-fast case. 

Proposition 15. The following estimate holds, where the trace is taken in the L 2 (I)-sense, 

Tr [ e A ^ s ^C^u s )e A ^ds < £ I {a\\u s \\% {1) + P\\u a \\v lx) + ^e^^^ds 
Jo ^Jo 

for all t € [0, T] and all functions u € C([0, T], L 2 (J)) with a, /3, 7 three constants. 

Proof. This is a direct consequence of Proposition [l3j For an explicit example, see Section |1J □ 

In particular, the operator Q t defined by 

Qt : i> / e A(t ~ s) C{u s )e A{t ~ s) ^ds 
Jo 
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with (j, u) € {1, • • • , 1} X C([0, T], L 2 (I)) is of trace class in L 2 {I). The Langevin approximation of 
m is then well defined as stated in the following proposition. We recall that in the all-fast case 



F <t>( U ) = -jy 5353 C eM(«)^)£ 2 (I))(0( U £ ~ (uAzi)^(I 



for it e L 2 (7). 

Proposition 16. Let e > 0. TTie STOi; 

dw e = [Aw £ + F^ e )]dt + y/eB^u^dWt (43) 

loii/i initial condition uq and zero Dirichlet boundary condition has a unique solution with sample 
paths in C([0, T], L 2 (I)). Moreover the quantity 

sup E(||^||* } ) (44) 
te[o,T] 

is finite. 

Proof. Thanks to the properties of the laplacian operator, the local Lipschitz continuity of Fq and 
Proposition [6j we can apply classical results on SPDE, see for example [T3]- The bound (44) is 



obtained using arguments similar to those used in the proof of the following theorem. □ 
We proceed to the proof of Theorem [3] 

Theorem 7. Let T > held fixed. The Langevin approximation is indeed an approximation of u 

limE[ sup ||ut-u£||£a (J) J =0 (45) 



, te[o,T] 



Proof. First we notice that we have 



u t - u t 

* e A ^~ s \F4ul) - F^u,))da + Ve [ e A ^ B^OfidW. 
o Jo 

We deal with the two above terms separately. Recall that for any u € L 2 (I) 



F 4>i u ) = -^^^c^iiu,^^)^^)^)^ - (u,<p Zi ) L 2 (I 
-^/((u,^J L 2 (/ 



/ j J \ \~1 T^jJ JYZj 

If moreover u 6 L 2 (I) we have 

\f{{u,(j) Zi ) L 2 {I) ) - f((u,<p Zi ) L 2/n)\ < maxc e (l + max|u e | + \\u\\ L 2 {I) )\\u - u\\ L 2 (I) 
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We have, using the fact that the quantity sup tS [ 0T ] ||i*t ||z, 2 (j") is finite almost-surely 

ft 2 
JO L 2 (I) 

E i E [\f{& e ML>(i)) - /((«., ^ i )L 2 (/)))e- (fe ' r)2( *- s) rf S (^ i ,/ fe )L 2 (/)/ fe 

fc>l JV 4 £AA- y ° 

= E ( ^E f\f((* e Mvw) -/((«»- ^)^(/)))e-^ 2 ( t - s ^ S (^ i ,/ fc ) i2(I ) ) 

^ |EE^'A)i j (/)ff(/(( i ^'.)^m)-/((''..^)yw)) e " NJMlij 



L*(I) 



< 



< 



TV 
TV 



51 E^'-^W) ( I maxc c 

EE(^'^)W) ( f w -u s \\ L 2 {I) ds 



(1 + max|t; c | + ||u ;s || L 2 (J) )||u £ - u s \\ L 2 {I) ds 



where C\ and C2 are two deterministic constants depending only on T. Thus, there exists a constant 
C3 depending only on T such that 



{F^iQ - F^u a ))di 



L*(I) 



We prove now that there exists a constant C4 such that 



E sup 

\te[o,T] 



f e A ^- s ^B{u £ s )dW s 
Jo 



\U -U S \\ L 2^) 



< Ca 



ds 



(46) 
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Using the Burkholder-Davis-Gundy inequality we see that 



E sup 
\*e[o,T] 



s A ( t- *)B^(Ug)dW a 
= e( sup J2( t <eA(t ' S)B ^ e s)fkJk>dp k (s)) 

\tZlO,T\£i\Jo J 

< VE ( sup f /* < e^^B^MJu > ) 



<e A ^B^ul)f k J k > 2 



fc>i V- 70 

< E ^Tr jf e As C (^_Je As ds^ 



< C 4 

with C4 a constant depending only of T according to Proposition [6] and Proposition [7] From the 
above inequality we obtain that 

E( sup \\u e t - Ut\\ 2 LHl) ) 
te[o,T] 



= E sup 

\te[o,T] 

< 2E f sup 

Vte[o,T] 



e A (*-)(J^(«;)-i^(«.))d» + Ve / e A(t - s) S(^)d^ 



L=(J) 











F<f,(u s ))ds 


' ) 


+ 2eE ( sup 


r e *{ts)B(u e s )dW s 




L 2 (I)J 


\te[o,T] 


Jo 



< 2E ( [C a ( sup \\u e t -u t \\ L 2 (I) ds\ 

\\ Jo te[o,«] y 

< 2CjT [ E ( sup \\u$ -Ut\\ 2 L 2 (I) ] ds + 2eC 4 

Jo \te[o,s] y 

A standard application of the Gronwall's lemma yields the result. 



□ 



4 Example 

We consider in this section a spatially extended stochastic Morris-Lecar model. Since the seminal 
work [52], the deterministic Morris-Lecar model is considered as one of the classical mathematical 
models for investigating neuronal behavior. At first, this model was design to describe the voltage 
dynamic of the barnacle giant muscle fiber (see [53] for a complete description of the deterministic 
Morris-Lecar model). To take into account the intrinsic variability of the ion channels dynamic, 
a stochastic interpretation of this class of models has been introduced (see [7j [38] and references 
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therein) in which ion channels are modeled by jump Markov processes. The model then falls into 
the class of stochastic Hodgkin-Huxley models considered in the present paper. Let us proceed 
to the mathematical description of the spatially extended stochastic Morris-Lecar model. In this 
model, the total current is of the form 

G r K r Ca (w) 



1 

C 



— V li(r K (i))c K (v K -u(zi))6 Zi + — V li(r Ca (i))c Ca (« Ca -ii(z J ))<5 2 , +/ 
iV K £7i_ ^V Ca <-f 



iSJV K 



and the evolution equation for the transmembrane potential 



d t u t 



2RC 



Au t + G t k r ca(u t ) 



on [0, T] x [0, 1] and with zero Dirichlet boundary condition. The total current is the sum of the 
potassium K current, the calcium Ca current and the impulse /. The positive constants a, R, C are 
relative to the bio-physical properties of the membrane. When the voltage is held fixed, for any 
i € J\f q where q is equal to K or Ca, r q is a continuous time Markov chain with only two states for 
closed and 1 for open. The jump rate from 1 to is given by f3 q (u(zi)) and from to 1 by a q (u{zi)). 
All the jump rates are bounded below and above by positive constants. We will assume that the 
potassium ion channels communicate at fast rates of order - for a small e > 0. The calcium rates 
are of order 1. The invariant measure associated to each channel i £ A/"k is given by 



fJtf{u(Zi)) 



a K {u(zi)) 



s a K (u(zi)) + p K (u(zi)) a K {u{zi)) + /3 K (u(zi)) 
Therefore the averaged applied current is 



F r Ca(lt) 



1 

C 



-E 



a K (u(zi)) 



N K £ri a K {u{zi)) + f3 K (u(zi)) 



ckOk ~ u(zi))8 Zi 



-—- V li(r Ca (i))c Ca (wca-u(z l ))(5 2l +/ 
^ca : trrf_ 



i6A/" Ca 



In this case the application $ of Theorem [2] reads as follows, for (u, r) € H x TZy 



$(u,r) 



1 1 

CN* 



E c k(v k - u(zi))S Zt I 



a K {u(zi)) 



a K (u{zi)) + f3 K (u(zi)) 



ds 



Of course, in this case, the law of (rf' u (i),s > 0) can be fully explicited. After some algebra one 
obtains 



r) = 



CK 



1 1 



C N K ff a K (u(Zi)) + /3 K (u{z,)) 



E 



(«K - u(zi)) l\{r{i)) 



a K (u(z l )) 



a K (u(zi)) + p K (u(zi)) 



Then the diffusion operator is given for u £ H by 

/ nKf u / v 1 2 / / ^2 a K (u(zi))b K (u(zi)) 

< C (u)(j>, ip >= —2 c K (v K - u(Zi)) 



K ieJVk 



(a K {u(zi)) + /3 K (u(zi))) 3 



< 5 Zi ,<j>>< 8 Zi ,ip> 
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for {(f), tp) £ H x H. From the above expression, we see that for any u £ H, C K is not of trace class. 
However, let us consider, for t 6 [0, T] 

Qt : 4> € L 2 (I) ^ f e A{t - s) C K (u s )e A(t ~ s Uds 



where (u s , s € [0,T]) is the averaged limit. In the L 2 (/)-sense, we have, for any t > 
TrQ t 

k>i N i^vk ^° ("kOm^)) + /3kK(^))) 3 

< c K (KI + sup IHU) sup ^ 



te[o,r] y m + /3K(y)) 3 ^ {kn) 2 

which is a finite quantity. 

We present in Figure [l] numerical simulations of the slow fast Morris- Lecar model with no Calcium 
current for various e > 0. The averaged model (denoted by e = 0) and the trace of the diffusion 
operator are also plotted. We set the calcium current equals to zero in our simulations to emphasize 
the convergence of the slow-fast spatially extended Morris-Lecar model towards the associated 
averaged model. See Figure 2 for simulations of the deterministic finite dimensional Morris- 
Lecar system with no calcium current. We observe in Figure [T] that averaging affects the model in 
several ways. As e goes to zero, the averaged number of spikes on a fixed time duration increases 
until finally form a front wave in the averaged model (e = 0) . In the same time the intensity of the 
spikes decreases. Let us also mention the fact that the trace of the diffusion operator is higher in 
the neighborhood of a spike in accordance to |38j where the same phenomenon has been observed 
for the finite dimensional stochastic Morris-Lecar model. 



A Numerical data for the simulations 

Here are the numerical data used for the simulations of the Morris Lecar model 

C = 1 c K = 32 v K = -70 
a = 1 c Ca = u Ca = 
R = 0.5 N K = 50 iV Ca = 

The length of the fiber is I = 0.5 and the time duration is T — 2.4. The impulse / is of the form 

I(x,t) = Alp.o.ijO) 

with A = 300. The data for the internal resistance R and the capacitance C are arbitraly chosen 
for the purpose of the simulations. The values for the other parameters correspond to |29j . 
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Figure 1: Simulation of the spatially extended Morris-Lecar model with no Calcium current for 
s equal successively to e = 1 (up left) e = 0.1,0.01,0.001,0.0001 (upper left corner) and e = 
(lower right corner), that is for the averaged model. The plotted curve (up right) corresponds to 
the corresponding simulation of the Morris Lecar model on its left side, it is the plot of the function 
t t— > Tr Q t . A stimulus have been injected to the membrane during all the time duration of the 
simulation on the portion [0,0.1] of the fiber. 



31 



[2] Azais, R., DuFOUR P., Gbgout-Petit, A. (2012). Nonparametric estimation of the jump rate for non- 
homogeneous marked renewal processes. To appear in Ann. I. H. P. 

[3] Berglund N. and Gentz B. (2006). Noise-Induced Phenomena in Slow- Fast Dynamical Systems. A Sample- 
Paths Approach. Springer. 

[4] Benaim M., Le BORGNE S., Malrieu F. and Zitt P-A.(20 12). Quantitative ergodicity for some switched 
dynamical systems. Submitted, http://arxiv.org/abs/1204.1922 

[5] Benaim M., Le Borgne S., Malrieu F. and Zitt P-A . (2012). Qualitative properties of certain piecewise 
deterministic Markov processes. Submitted, http://arxiv.org/abs/1204.4143 

[6] Brandejsky A., Dufour F. and De Saporta B.(2012). Numerical methods for the exit time of a piecewise- 
deterministic Markov process. Adv. in App. Proba. 44. 

[7] BuCKWAR, R. and Riedler, M.G. (2011). An exact stochastic hybrid model of excitable membranes including 
spatio-temporal evolution. J. Math. Biol. 63, pp. 1051—1093. 

[8] Cerrai S. and Freidlin M.(2009). Averaging principle for a class of SPDEs. Prob. Th. and Rel. Fields 144, 
pp. 137-177. 

[9] Chow, C.C. and White, J. A. (2000). Spontaneous action potentials due to channel fluctuations. Biophys. J. 
71, pp. 3013-3021. 

[10] COSTA, O. and Dufour, F.(2011). Singular Perturbation for the discounted continuous control of piecewise 
deterministic Markov processes. Appl. Math, and Opt., 63, pp. 357-384. 

[11] COSTA, O. and Dufour, F.(2012). Average Continuous Control of Piecewise Deterministic Markov Processes. 
Submitted. 

[12] Crudu A., Debussche A., Muller A. and Radulescu O. (2011). Convergence of stochastic gene networks 
to hybrid piecewise deterministic processes. To appear in Ann. of App. Prob. 

[13] Da Prato G. and Zabczyk J. (1992). Stochastic Equations in Infinite Dimensions. Cambridge Univ. Press 

[14] Davis M.H.A.(1984). Piecewise-deterministic Markov processes: a general class of non diffusion stochastic 
models. Journ. Roy. Soc. 46, pp. 353-388. 

[15] Davis M.H.A. (1993). Markov models and optimization. Monograph on Stat, and Appl. Prob. 49. 

[16] Duan J., Roberts, A. AND Wang W.(2010). Large deviations for slow-fast stochastic partial differential equa- 
tions. Technical report, Univ. of Adelaide, |http: / / ar xiv.org/ abs / 100 1.4826| 

[17] Ethier, S.N. AND Kurtz, T.G. (1986). Markov Processes: Characterization and Convergence. John Wiley, 
New York. 

[18] Faggionato, A., Gabrielli, D. and Ribezzi Crivellari, M. (2009). Averaging and large deviation principles 
for fully-coupled piecewise deterministic Markov processes. To appear in Markov Proc. Rel. Fields 137, pp. 
259-304. 

[19] FlTZHUGH, R. (1960). Thresholds and plateaus in the Hodgkin-Huxley nerve equations. J. Gen. Physiol. 43, 
pp. 867-896. 

[20] Genadot, A. and Thieullen, M.(2012). Averaging for a Fully Coupled Piecewise Dterministic Markov Process 
in Infinite Dimension. Adv. in App. Proba. 44. 

[21] Fox, L. (1997). Stochastic Versions of the Hodgkin-Huxley Equations. Biophys. J. 72, pp. 2068-2074. 

[22] GOREAC D.(2011). Viability, invariance and rechability for controlled piecewise deterministic Markov processes 
associated to gene networks. ESAIM: Cont. Opt. and Calc. Var.. 



32 



[23] Henry D. (1981). Geometric Theory of Semilinear Parabolic Equations. Lecture Notes in Mathematics, 
Springer Verlag, Berlin, Heidelberg, New York. 

[24] Hille, B. (2001). Ionic Channels of Excitable Membranes. Sinauer Sunderland, Mass. 

[25] Hodgkin, A.L. AND Huxley, A.F. (1952). A quantitative description of membrane current and its application 
to conductation and excitation in nerve. J. Physiol. 117, pp. 500-544. 

[26] JACOBSEN M. (2006). Point Process Theory and Applications. Birkhauscr. 

[27] Lopke r, A. AND PALMOWSKI Z. (2011). O n Time Reversal of Piecewise Deterministic Markov Processes. Sub- 
mitted, http:/ /arxiv.org/abs/1110.3813 

[28] Metivier, M. (1984). Convergence faible et principe d'invariance pour des martingales a valeurs dans des 
espaccs de Sobolcv. Ann. I.H.P. 20, pp. 329-348. 

[29] MORRIS C. and Lecar H.(1981). Voltage oscillation in the barnacle giant muscle fiber. Biopysicla J., 35, pp. 
193-213. 

[30] Pakdaman K., Thieullen M. and Wainrib G. Asymptotic expansion and central limit theorem for multiscale 
piecewise deterministic Markov processes. To appear in Stoch. Proc. Appl. 

[31] Pavliotis, G. and Stuart, A.. Multiscale Methods, Averaging and Homogenization. Springer Verlag, Berlin. 

[32] Renardy, M. and Rogers, C. An Introduction to Partial Differential Equations. Springer Verlag, Berlin. 

[33] Riedler M.G. (2010). Almost Sure Convergence of Numerical Approximations for Piecewise Deterministic 
Markov Processes. Heriot- Watt Math. Report. 10-34. 

[34] Riedler M.G. (2011). Spatio-temporal Stochastic Hybrid Models of Biological Excitable Membranes. PhD 
thesis, Heriot- Watt Univ. 

[35] Riedler M.G., Thieullen, M., and Wainrib, G. (2011). Limit Theorems for Infinite Dimen- 
sional Piecewise Deterministic Processes and Applications to Stochastic Neuron Models. Submitted, 
|http://arxiv.org/abs/1112.4069| 

[36] Roberts A. AND Wang W. (2009). Averaging and deviation for slow- fast stochastic partial differential equa- 
tions. Technical report, Univ. of Adelaide, |http: / / arxiv .org/ abs/0 904. 1462| 

[37] Tyran-Kaminska, M.(2009). Substochastic semigroups and densities of piecewise deterministic Markov pro- 
cesses. J. I of Math. Anal, and App. 357, pp. 385-402. 

[38] Wainrib G. (2010). Randomness in neurons : a multiscale probabilistic analysis. PhD thesis, Paris 6 Univ. 

[39] Yin G. and Zhang Q. (1997). Continuous-Time Markov Chains and Applications: A Singular Perturbation 
Approach. Springer Verlag, Berlin. 

[40] Yin G. and Zhu C. (2010) Hybrid Switching Diffusion. Springer Verlag, Berlin. 



33 



